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Abstract. We discuss the collective behavior of a network of individuals that receive, 
process and forward to each other tasks. Given costs they store those tasks in buffers, 
choosing optimally the frequency at which to check and process the buffer. The 
individual optimizing strategy of each node determines the aggregate behavior of 
the network. We find that, under general assumptions, the whole system exhibits 
coexistence of equilibria and hysteresis. 
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1. Introduction 

The study of the interaction between people processing tasks is at the base of the science 
of social networks [T]. Recently the huge amounts of data coming from the analysis of 
e-mail networks, web communities and social databases, have motivated the study of 
statistical properties and related models of such human activities [Zl |3l HJ El E] . 

A more complete analysis should take into account also the 'costs' associated to 
the execution and storage of tasks, that transform any individual decision in a non- 
trivial economic optimization problem. By costs we broadly intend any negative return 
deriving from the process. In the case of execution it could be the effort and time spent, 
in the case of storage it could be the risk that the information or the payoff conveyed by 
the task become too old and hence useless. In such cases the problem would be that of 
finding an optimal balance between those two different aspects. Human activity is thus 
the result of a complex intertwined two-levels problem. On the one hand, there is the 
individual problem of optimal timing (or optimal stopping [7]) encountered by rational 
agents in many economic situations, and object of investigations in operations research 
(as in optimal delivering [8]), finance (e.g. in the case of American options, see [9]), and 
macroeconomics (e.g. optimal retirement, as in [ID]). On the other hand, we have the 
network queueing problem resulting from the interactions between individuals, deeply 
studied in computer science [Hj and recently in statistical physics as well [I2l [13] . 

The general problem can be formulated in the following way. Let us consider a 
network of rational agents sending each others different tasks to be executed. An agent 
gets positive payoff from processing a given task, but faces also some fixed and variable 
costs. For this reason the agents can store tasks in queues and decide the optimal time 
intervals at which the queues are checked and processed. There is however a trade-off 
in delaying task processing, because there is always the risk, waiting too long, that tasks 
becomes too old to be worth being processed. 

In principle, if tasks have different priorities (according to the models proposed 
in the literature [HI El El [HI [15]), every agent should have different queues with 
different costs, each one containing tasks with similar priority. The optimization problem 
associated with each queue produces different processing times, and we expect that tasks' 
heterogeneity would be reflected in the heterogeneity of processing times as observed in 
real data [HHSl [T71 HE] . Whereas a complete understanding of task-completion processes 
in human dynamics seems at present very challenging, a first step in this direction is 
represented by understanding the relation between individual optimization problems 
and the collective behavior. 

In the present paper we study a version of this general model in which individuals on 
a homogeneous network receive tasks from an external source and interact by processing 
and forwarding each other those tasks. All tasks have the same priority and the 
individual problem consists in computing the optimal processing rate that maximizes the 
individual utihty. Because of interaction, the individual strategies depend on the global 
behavior of the system, producing interesting collective phenomena. We find analytically 
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that, for some values of the parameters (i.e. external arrival rate of tasks, and costs), 
there are two possible stable equilibria for the collective optimal strategies: one in which 
nobody process tasks (trivial equilibrium), and one in which every individual process 
tasks with the same non-zero rate. Depending on the nature of costs, the transition 
between the two behaviors may not be continuous, and interesting hysteresis phenomena 
can be observed. 

Understanding the effects of costs on the individual strategy is far from being of 
purely theoretical interest. Indeed, American e-mail providers AOL and Yahoo proposed 
in February 2006 a taxation on e-mails in order to reduce the phenomenon of spammingQ 

The paper is organized in the following way. In Section [2] we focus on the individual 
behavior, characterizing the optimal responding strategy under the assumption of 
Poisson statistics for the arriving tasks. We leave part of the detailed calculations, 
for this and the following sections, to Appendix B In Section [3] we discuss the network 
process, and derive the stationary states under the assumption that single individuals 
respond optimally. We assume, in order to obtain clear analytic results, that the network 
is homogeneous of fixed degree. It is clear that the network structure will heavily depend 
on the specific environment (e.g. even for e-mails networks alone, different datasets 
have shown different topologies [HI [20]). Section H] illustrates the main results about 
the collective behavior of the model, depending on the external parameters. Section [5] 
generalizes to non-regular networks. Conclusions and plans for future research are left 
to Section [61 



2. Individual behavior 



In this section we focus on the optimization of individual response strategies when the 
agents receive homogeneous tasks (e.g. e-mails, jobs,...) to process and/or forward. 
Tasks arrive from outside, in general both from an exogenous source and from other 
agents, but we ignore this distinction for the moment. The only relevant assumption 
on individual behavior is that the agents have limited knowledge of system's dynamics, 
thus they always perceive the arriving tasks as Poisson independent events. The arrival 
rate A is estimated monitoring the queue during the dynamics. 

Arriving tasks are stored automatically in a queue (e.g. e-mail buffer), and the 
agent gets payoffs from processing tasks in her queue. Each stored task has the same 
positive payoff tt > 0, but this payoff becomes at a Poisson rate /i. Tasks with zero 
payoff are nor executed neither forwardedfi Among the tasks which are stored in the 
buffer, we will call survived those that maintain the positive payoff. 

Another important ingredient of real human dynamics is that individuals are not 
constantly monitoring their tasks list. For instance, people have to connect to the 

See e.g. The New York Times from February 5 2006, online at: 
http://www.nytimes.com/2006/02/05/technology/05AOL.html . 

If they are e-mails, the information they convey may become outdated. Generally, in the case of 
jobs or other opportunities, it could suddenly become too late to process them. 
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Internet in order to check their web-mail window, and employees that have constant 
access to the web cannot spend their work-time constantly monitoring their mail-box. 
Note that this cost can be arbitrarily small. Therefore, in our model an agent is not 
constantly monitoring her buffer, and some fixed cost C > is paid whenever the queue 
is accessed. Let us suppose that, opening the buffer, an agent finds i new- arrived tasks, a 
non-negative cost c < vr is associated to check each of them|^ As anticipated, the agent 
processes only the n tasks that still give a positive payoff vr. Assuming a separable 
utility function, the overall net payoff is utt — ic. Note that in this model, an agent does 
not execute the tasks bringing null utility; this could be formalized with an additional 
positive cost n for processing tasks. This cost would only re-scale vr to tt — k, so that, 
without loss of generality, we ignore this detail in the rest of the paper. 

The individual optimization problem is the following: the agent has to choose a 
Poisson rate z/ at which to check her buffer (and consequently process it). Note that 
the condition c < vr prevents the trivial strategy, according to which it is always better 
not to check. We normalize costs and payoffs, setting vr = 1, so that c and C are just 
ratios, with the property that c < 1. Without loss of generality we also normalize the 
time setting /x = 1 so that our new A will be actually the ratio -, and similarly for u. 

The problem is to maximize the long run (r oo) payoff per unit time, from the 
present time onwards: 

1 r'-^^'^Kr^ ^^\ E,,^[U{u, X)] 



max < lim -r— — / ?7(z/. A) > = max 



T{u)Jr ^ ' ^ E^[T{u)] 

^ E^,Mi^,\)-iiu,\)c-C] 

l/v ^ ' 

E^\T{u)] = ^ is the expected time between two checks of the queue, while E^j^xiaiy, A)] 
and Eyxlniy.X)] are respectively the expected total arrived and survived tasks in the 
buffer. All expectations are taken on the stochastic process with fixed A, that is a 
parameter at the individual level, and the free quantity to tune the optimization 
process. The optimization problem can also be derived from a Bellman equation, in the 
limit where the discount rate goes to 1 (see Appendix A for details). 
The optimization problem from Eq. [T] reduces (see Appendix B) to 

where, moreover, 

EuM = -, (3) 



and 



EuAn] = ^ . (4) 



ji The cost c can be thought as the cost of reading an e-mail or just checking if a job is still worth 
being processed. 
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Imposing the extremization in Eq. [2] leads to 

Setting /i = 1 and re-normalizing the other rates with respect to fi, the optimal 
processing rate of the queue is 



(6) 



The dependence on the costs c is restored by the condition that the optimal rate 
of utility is not negative (since not answering at all would guarantee zero payoffs and 
costs). Imposing U* >0, 



U* 



A A 
c — 

+ 1 V* 

\ A 



C 



C> 



V > 



1 - 



(7) 



where is always non negative for c < 1. In summary, the two conditions that 

ensure individual strategy's optimization are 



A - 1 

c 







if 

otherwise 



^ - 1 > 
c ^ 



(8) 



In general, one can safely assume the buffer capacity to be infinite, but for some 
reasons that will be clear later, one can also be interested to the case in which the queue 
length L is finite. The maximization problem (Eq. [2]) is now (see Appendix B ) 

L 



max 

V 



A 



A + 



cA 



Cv 



(9) 



The problem in Eq. [9] has a unique solution which depends on both c and C . The 
solution is however non-algebraic, even in the case c = 0. 



3. Collective behavior 

We consider now many agents located on the nodes of a network, with a given topological 
structure. Individually, each agent behaves as discussed in the previous section, but now 
individual A's depend on the collective behavior. For the sake of simplicity we consider 
a homogeneous network, of fixed degree and assume that all agents behave similarly. 
Each one of them receives tasks exogenously at a Poisson rate Aq (also normalized with 
respect to When an agent processes a task contained in her buffer, this task is 
forwarded to all neighbors with a constant and uniform probability p > 0. This is 
the probability that a given task is forwarded to a specific neighbor or a probability of 
successful transmission. In the framework of e-mail networks, it can be the probability 
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that a friend is interested in the subject of a given e-maiL Under this scenario, an agent 
receives tasks from outside (at a rate Aq) and from neighbors (at an unknown rate). 
The overall rate A is estimated by the agents themselves under the assumption that the 
arrival events are Poissonian. This is a good assumption as far as p <^ 1. Note that, 
assuming homogeneity, A is the same, in expectation, for all the nodes of the network. 

The number of tasks ii arriving in the buffer of agent i is partly coming from her 
Ni neighbors and partly from outside, in symbols 

i^ = io^^ + E ^.-^ ' (10) 

and similarly the number of surviving tasks is 

Hi = no^i + E ^i^i • (11) 

We will proceed in steps to study the stochastic processes associated to these variables. 
The first step is that of deriving coupled equations for the generating functions of this 
stochastic process on the network. 



3.1. Generating functions approach to the stationary state 



Since the process is based on the assumption that arrival events are Poisson distributed, 
the generating functions formalism [21] turns out to be very useful to analyze the 
stationary collective behavior of the system. Moreover, the procedure (detailed in 



Appendix B) holds for any network structure under local tree approximation. 



The overall generating function for the probability that i has received a certain 
number of tasks ii (between two consecutive processing events) is defined by 

_ , . J^i -r-r 



E 



s' 



^i[S 



n 



(12) 



Z/, + (1 - s)Xo jif,^ (1 + (S - l)p)] Vj 

The overall generating function \E'j(s) for the number of tasks that are still active 
when i process the buffer is instead 



z/, + 1 + (1 - s)Ao + 1 - (l + (s - l)p^ 



.(13) 



3.2. Stationary state of the regular network 

Eq. [13] can be easily solved in a regular network of degree K. In this case, we expect 
z/j = Uj for any i and j, and Eqs. 

E{s) 



become 



1 



u+{l-s)Xo V2-*(l+(s-l)p) 



) 



1 



(14) 

v+l+(l-s)Ao 1^2-*[l+(s-l)p^]i/^ 

The expected values for ii and can be computed as the derivatives of generating 
functions in s = 1. From Eq. [THwe get 

Ao 



E{n\ = ^'(1) 



1 + {l~pK)u 



(15) 
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From 



we get 



S'(l) = ^ + pK^'(l) (16) 

In Eqs. US] and [T7| the relevant parameters are Aq, and the product pK, which 
represents the expected number of forwarded tasks per processed one by a single node. 
We will call it 

m = pK . (18) 
Noting that the expected rate A is actually vE[l], we have that 

A^ /°<: + ^> . (19) 

Using Eq. [19] and the optimality relation v = — 1, we obtain the condition 

^ = (1 - m)v 

from which the optimal processing rate v can be determined 



c 

^ = (l-m)i^' + (2-m)z/+l , (20) 



3. 3. Approach to the stationary state: stability under a learning process 

Note that the condition in Eq. [201 determines the stationary state of the queueing process 
on the network. Starting from a random initial condition, i.e. random distribution of 
processing rates {t'i}, the system should self-organize to reach some stationary state 
satisfying the above relation. A realistic way to generate this self-organization is by 
means of a learning process for the quantity Aj for each node i of the system. Assume 
that agents update their expectations about Aj every time they process the buffer (times 
are indexed by discrete t's), using the linear rule 

A,,(t+l) = (l-e)A.(t)+e|||, (21) 

where ^i{t) is the number of tasks arrived in z's buffer, and Tj(t) is the actual time-lag 
between t and t + 1 . 

In expectations, Eqj2T] becomes trivially 

\{t + 1) = \{t) + e(v,E[ti] - \{t)) . (22) 

If we substitute et' = t, going at the limit e — >■ we obtain the dynamical equation 

^ = u,E,^[i,] - Kit') , (23) 
where Ui = — 1 is a function of Aj, and E^^[ii] is given by Eq. [T71 
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Imagine a small perturbation around the stationary value A*, so that Aj(t') = 
X* + 5\i{t'). Eq. [23] gives 

^^A: + A(.i..jq)|;.A.-A;-.A. + o(aD 

^ ^'"^ ^ l]6X. + 0{5X^). (24) 



V[l + (l-m)z/i]2 
The system is stable if the term in the brackets is negative, i.e 

XoTJl 1 



1 < , (25) 



[1 + (1 - m)z/,]2 2v^ 
substituting with Eq. [T9l 

Ao(j/. + l)2 2yA;C- • ^ ' 

Finally, using Eq. [6l we get the stability condition 

Xn m m , 

— > —Vi H . (27) 

C - 2 ' 2 ^ ' 



that is always satisfied under Eq. [201 when m < 1. When instead m > 1, Eq. [20] is 
a downward parabola and Eq. [27] is satisfied only as long as ^ is increasing in Vi (see 
Section [ID . 

Note that, as we defined the learning process, agents update their beliefs only when 
processing their buffer. This means in principle that they could assume E[Xi\ to be 
actually smaller than Aq, because they don't know Aq. In this case they could all play 
the strategy z/j = and never update beliefs. The rate Aq could be very high but agents 
would never find out. To avoid similar paradoxical situations, in the following, we will 
assume that agents know Aq and also know that E[Xi\ > Aq. In other terms, Eqj2T] 
becomes 

T(t) 

As expected from the regularity of the network, in the stable case all the ViS will converge 
to the same z/ given by Eq. [20 



A,(t + 1) = max {(1 - e)A,(t) + e-^ , Aq} . (2^ 



The next section and Appendix C are devoted to a detailed analysis of the 



stationary collective behavior of the system depending on the external parameters. 
4. Results 

The system's stationary behavior depends on Eqs. [H]and[20l and on the stability analysis 
of the learning process (Eq. [27]) . The overall scenario emerging from these equations is 
very rich, since the collective behavior changes varying m = pK, Xq/C, and c. These 
form the minimal set of independent external parameters of the model. 

We analyze the different behaviors of the system studying the 'phase diagram' of 
u as a function of Aq/C, when the value of m is fixed with respect to c. As m varies, 
there are 4 possible distinct cases. We treat here the two most illustrative ones, leaving 



the remaining two to Appendix C 
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A.|j/C = {m/2) V + {m/2) ^ 


m<1 


/ y 




~k.^lC = C\ -m) + {2-m) v +1 




'y:''^ /(1 -c^'^) 






1 





(1- m c^'^) / (1 - c^'Y 1 / (1 - c''2)2 0' 



Figure 1. When m = pK < 1 there is at least a stable solution for every value of 
but there are two in the illustrated interval. 



4.1. Case m < 1 

When m < 1, the number of tasks present in the system does not grow, the queue 
lengths are bounded, and the dynamics always reach a well defined stationary state. 
This is the most realistic scenario, illustrated in Fig. [H The trivial state in which all 
agents prefer not to process the tasks, z/ = 0, is always a possible stable equilibrium 
as long as Aq/C < j^^z^^- Above this value, the trivial strategy is suboptimal for any 
single individual even if adopted by all the others. Eq. [2D] predicts the appearance of a 
non trivial solution with i/ > for Aq/C > 1, but the corresponding value of the utility 
is non-negative only for Aq/C > ^^1"^2 ■ The stability condition for this solution (see 
Eq. [27]) is always satisfied. 

From Figure [I] we see that an interval exists, where both solutions are possible 
and stable. When Aq/C is in this interval, the system will converge to one of the two 
possible equilibria depending on the initial conditions, and hysteresis-like phenomena 
can be observed. Note that this co-existence of equilibria is not refiected at the level 
of single instance: due to the hypothesis of network homogeneity, in a single realization 
of the dynamics all agents (possibly with different initial conditions) converge to the 
same state, with A given by Eq. [191 The variable cost c does not affect the shape of the 
functions describing the two possible equilibria, but it affects their region of admissibility 
and the interval of co-existence. This interval shrinks to zero in Aq/C = 1, at the limit 
c — 0. As c grows this interval is right-shifted and its size grows. 

These solutions have been verified numerically using continuous time simulations. 
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m > 2 / 



X / C = (m/2) V + (m/2) 



(unstable) 



Figure 2. When m = pK > the only stable solution is the trivial one, for 

In this case, the non-trivial solution z/ > is always unstable, as shown in Fig. [2] 
obtained combining Eq. [20] with the conditions imposed by Eqs. [8] and [271 The trivial 
solution 1/ = exists as long as ^ < ^r^T^p-- Above this value, no stationary solution is 
expected. The variables A and z/, as well as the buffer's length, will explode to infinity for 
all nodes, since the generation rate Aq will be higher than the deletion rate (due to p, K 
and the z/'s). Since m > 1, this can happen also for ^ < ^^J'^y , if the initial processing 
rates are sufficiently high. In this case one can speak about congestion of the system. 
One possibility to avoid congestion is to put a bound L < oo to the buffers' length: 
tasks arriving when the buffer is full are neglected. The corresponding optimization 
problem (Eq. [9]) can be solved numerically, even if the optimal value of i> for L ^ 1 will 
not differ considerably from the previously considered one. Imposing the bound L < oo 
in the learning process, we get 

A.(t+l) = (l-.)A.W+.=|^. (29) 

Now, implementing this learning process in simulations, we find an additional stationary 
solution at a large value z>, which is independent on the value of the parameter ^ (and 
also on the learning parameter e, necessary for the simulations). 
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5. Non— homogeneous networks 

It is possible to derive the behavior of the system also in a non-homogeneous network. 
Here we restrict to some considerations that generalize previous sections. Assuming 
that the structure of the network is uncorrelated, Eq. [13] for a /c-degree node becomes 



z/fc + l + (l-s)Ao 



^ k'P{k') Vk 



(k) + 



where P{k) is the degree distribution and (A;) is the average connectivity. We also 
generalize to a pk that depends on the degree k of the sender node. We can compute 

Aq ^ Pfc k'P{k' 
z/fc + 1 ^k + lr^ {k) 



E[nA = Kil) = 77^ + E ^^^^'^'.'(1) , (31) 

k' 



from which, calling 9 = J2k' ^'j^^k'^'k'i^)^ and using Eqs. OandlH we obtain 

Afc = Ao + kpkQ . (32) 

The rate A^ at which a node of degree k receives tasks is linear in k. By Eq. |8l giving 
the optimal z/^, and using again Eqs. [3] and HI we have 



e= E ^ (Ao + fcp.e) ( 1 - j n )"-^^®)' (33) 



where 



c 



d{e) = max { ^^^^ } (34) 

indicates the minimum kpk for which it is profitable to check the buffer (i.e. Uk = for 

kpk < d{e)). 

We are looking for the fixed points of F{Q), which are steady states of the system. 
The behavior is qualitatively the same as in the regular case. We can distinguish two 
cases depending on the parameter 

m = ^, (35) 

which generalizes the m defined in previous sections. 

In the case m > 1, since F{Q) ~ mG, for 0^1, one fixed point diverges to 
infinity, indicating a congested state. For Aq < (i-^^)2 there is another fixed point in 
G = 0, which correspond to the trivial solution = for any k. We are not excluding in 



principle other fixed points ( [Appendix C| shows how this applies to the regular network 
case) . 

Let us now address the case m < 1. When Aq > jj^^^, since d{Q) = 0, it is easy 
to see that F(0) > 0, F'(e) > and F"(e) > for any 6 > 0. There will be a unique 
non-trivial fixed point 0* in which all the nodes have a positive processing rate z/^, for 
any degree k. 

Finally, for m < 1 and Aq < -jjz^^, one fixed point is the trivial one = 0. This is 
the generalization of the admissible interval of the trivial strategy in the regular network 



^k' 
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case (see Fig. [T]). There could be other fixed points and hysteresis phenomena, as those 
described in Section HTTl depending on the specification of the network structure {P{k)) 
or of the agents behavior (pk). 

6. Conclusion 

Human task-completion dynamics can be formulated as a non-trivial economic 
optimization problem, in which individuals optimize their strategies of interaction with 
the rest of the system. We have studied a simple model of optimal queueing in a network 
of identical agents that receive tasks, store them in queues and process them following 
a well defined optimal strategy. 

The simplicity of the model allows to understand the different roles played by 
fixed and variable costs {C and c respectively) in the strategy optimization, and more 
generally it unveils the collective optimal behavior. Fixed costs C are associated with the 
action of controlling the state of the queue and processing the tasks, while variable costs 
c are associated to every received task. This can be interpreted as a way of introducing 
a cost function that is monotonously increasing with the number of task to process. 
It is simple to find examples in realistic situations. For instance, in e-mail networks, 
individuals do not check their mail-boxes all the time as it has a cost in terms of wasted 
time; hence they decide to check it at a certain rate that they consider optimal. 

We have shown that varying fixed costs does not change the type of transition 
from the not responding equilibrium to the dynamical steady states, but the position 
of the transition itself (fixing Aq, individuals are favored to respond as C decreases). 
The dependence on the variable costs is instead more surprising: when variable costs 
are absent, the transition is continuous, whereas for c > a discontinuity is developed 
that introduces a non-trivial hysteresis phenomenon in the collective behavior of the 
processing rate u. 

This model is a first step towards the understanding of the effects of individual 
optimization processes in collective human dynamics. Its simplicity allows to obtain 
several analytical results and a complete theoretical insight in the problem. There are 
many possible extensions of the model, it could be possible to introduce a multiple-queue 
system with some priority principle, as proposed in Ref. [22] for a similar problem. 

Another possibility could be to consider heterogeneous networks of agents, pushing 
forward the analysis of Section O As discussed there, we expect the general behavior 
of an uncorrelated network to qualitatively resemble the regular network case. It would 
be interesting to go beyond random networks, including e.g. degree correlation, and to 
study the network structure that realizes the best compromise between stability of the 
system, average utility and minimization of lost information. We leave this analysis for 
future investigations. 
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Appendix A. Bellman equation 

As in dynamic programming we compute the optimal strategy u* using the recursive 
Bellman equation for the value function V with given initial condition uq and with 
time-discount rate 6 = e~^, i.e. 

V;{uo, A) = max {e,,a [(l - e"^) U{u, A) + e'^'^'^V^iu,, A)] } , (A.l) 

where Tq is the time at which the queue is processed for the first time, the constant factor 
1 — is applied to every utility outcome (its role will be clarified in the following) 
and E;^ a['] is the average value of a quantity over the distribution of the arrival and 
processing Poisson processes. As the process is assumed to be stationary, Tj = T for all 
j and the equation simplifies to 

1 - e-^) E,,A [U{u; A)] 



V;{iy; A) = max \ 1 _ e, [e-^'^)] ( ' ^^'^^ 

The factor 1 — allows to take the limit /3 ^ of the Bellman equation keeping the 
value function measurable and giving the same weight to all future events. In this limit, 
the optimization problem reduces to Eq. [H 

Appendix B. Details of the analytic derivation 

Appendix B.l. Derivation of Eq. [H 

In order to derive an expression for the optimal processing rate (that is also the response 
rate) of an individual, we have to compute the expectations in Eq. [H The probability 
that the queue contains i tasks when it is observed is 

JO a! \X + u J X + u 

from which the expectation value 

oo \ 

£=0 ^ 

The conditional probability that only n tasks survive (i.e. have non-zero payoff when 
the queue is checked) out of the £ arrived ones reads 

Remember that, without loss of generality, we assume /i = 1 (and the relative 
normalization of v and A). We obtain the expectation value of n(z/. A), 

oo t 

^.,aN = E^-,AWE^^-,A(n|£) 

f=0 n=0 
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V 



X 



X + u X + u u + 1 Z/+1 z/ Z/ + 1 



The optimization problem from Eq. [T] reduces to 



A 



A 



max < u 

- 1 U + 1 



— c- 



C 
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(B.4) 



(B.5) 



Appendix B.2. Derivation of Eq. [H 

Eq. [T]is correct for i < L, but now Pu^xi^^) = for every i > L, hence 



L-l 



^=0 



The expected value of i is computed in the same spirit of Eq. IB. 21 but differently, 



X 



A + z/, 



Similarly Eq. IB. 41 becomes 



X 



1 



A + 



and the maximization problem (Eq. [2]) is now 

" / A \" 
1 



max 



X + v 



Xv 



-cX\-Cu 



. (B.6) 



(B.7) 



(B.8) 



Appendix B.3. Derivation of Eqs. [TH and 

The number of tasks arrived at node i from outside the system between two successive 
accesses to the queue has distribution 

Pi^o^^ = k)=( ' , (B.9) 



^Xo + UiJ Xo + Ui 
and the corresponding generating function reads 



4j,^,{s) = J2s'p{eo-,. = k) = - 



(B.IO) 



We have called z/j the optimal processing rate of the queue at node i. The probability 
distribution of the number of tasks with non-zero payoff is 

OO 1 _|_ 7/ / \ \ ^ 

P{n,^^ = k) = Y: P{a)P{k\a) = . J , ^ V , , (B.ll) 

and the corresponding generating function is 



+ 1 + s)Xo 



(B.12) 
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The same computations for and uj^^i are more complicated. Starting from the 
relation 

h=(} 

we first have to compute the probability that j discharges mj times her buffer before i 
discharges her own, i.e. 

P(m, =k)=( -^^] . (B.14) 

+ Uj ) Ui + Uj 

The generating function of this process is 

In each of these discharges the number of tasks forwarded to i has distribution 



P{^% = k) = Y.PAn)Qp\l - pT-' , (B.16) 

where Pj{n) is the probability that j finds n still active tasks when checking (i.e. with 
positive payoffs). The generating function for P(£j'!lj) can be expressed in terms of the 
generating function for Pj{n), 



^3^^is) = E Pi^f^^ = k)s' = E E ^.(^) ( ! (P^)'(l " PT"' 
k=0 k=On=k \'^/ 

oo oo /„\ oo 

= E E ^.H J (p^)'(i - pT'" = E P3in) {i + {s- i)pr 

n=k k=0 V / n=k 

^ v^, (1 + (s - , (B.17) 

so that is the generating function of j's buffer length. 

Putting things together, the generating function for the distribution of the number 
of tasks that i receives from j is 

ei^i((l>iJs)) = -^-^ -— — . (B.18) 

Recalling Eqs. [10] and IB.10| the overall generating function for the probability that i 
has received a certain number of tasks ^i (between two consecutive processing events) 
is defined by 

S^S) = ^0-.i(s) n i3^i{^3^ii.s)) 

= TT B 19) 

u, + {l-s)Xo^ij^^iy, + [l-^,{l + {s-l)p)]u, ■ ' 

One can repeat the whole procedure of Eqs. IB.14f[BTT8l from Eq. IB. 121 to obtain 
the overall generating function '^i{s) for the number of tasks that are still active 
when i process the buffer. 



I., + 1 + (1 - s)Ao ^.^^^ z/, + [l - (l + (s - l)p^ 



^3 



Optimization in task- completion networks 



16 



Appendix C. Other results 

We continue here, from Section HI the study of the phase diagram of as a function 
of Xq/C, as m varies with respect to c. When m > 1, congestion is always a possible 
outcome of the system, but it may coexist with stable non-trivial steady states, as long 
as m < Y^^- Since c < 1 there is an interval for m that characterize two possibilities, 
analyzed in this Appendix. 

Let us start by defining m' = 2 ^ i^^^y —- Note that, for c G (0, 1), we always have 
1 < m' < — 

Case 1 < m < m' 



V 



1 < m < 



(2-m) / 2(m-1) 



^ unstable 




>L /C = (1-m) v"" + (2-m) v +1 



>L / C = (m/2) V + (m/2) 



^^stable 



1 / (1 - 



I 



(1-mc^'2) 



/(I -c^'Y m^/4(m-1) 



Figure CI. When m = pK > 1 there are no stable solution for j^Z^/^' but there 
are two in the illustrated interval. 

When m > 1 the parabola determined by Eq. [20] is leftward. We have shown that, 
when m > > 1, the only stable solution is the trivial one = 0), as long as 

7; < (1-^)^ . The case m G (l,m'), illustrated in Fig. ICll is more interesting. The 
stabihty condition (Eq. [27j), intersects Eq. [20] at the vertex of the parabola, so that the 
upper branch of the solution is always unstable. This point is given by ^ = and 
Note that when m > 1, then 



2(m-l) ■ 



2 

m 



4(m — 1) (1 — ^JcY 

If [i-!/^'^ ^ ^ 4{m-i) there is another stable solution (see Fig. ICip which lies on 
the parabola. There is an interval with two stable non-intersecting equilibria, but one 
of them is valid only inside this interval, while the other is on a proper (at both sides) 
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overset of it. We assume not to observe any phenomenon of hysteresis, since agents will 
keep adopting the trivial strategy, no matter how we vary the parameter ^ across the 



interval 



(l-^/c)2 ' 4(m-l) 



Case m' < m < 
U m' < m < 



then Eq. IC.ll is not satisfied and there is hysteresis, as for 



the case m < 1. 



For ^ 



< 



Aq rz 
C ^ 



the trivial solution is the only stable one. For 



we have two stable equilibria (the trivial and the non-trivial 



one). Finally, for ^ > A , only the non-trivial one is possible, up to 



Cases m = m' and m 



(l-v^) 
2 



Ao 
C 



4(m-l) ■ 



represent the same situation at the limit of zero measures. 
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